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^11^ Attorr^lllll^ket No.: WMI-004 (8415/5) 

What is claimed is: 

1 . A hyperlinked broadcast systeir/comprising: 

2 a video source; / 

3 a video encoder in communication with said video source, said video 

4 encoder producing a transport stream; / 

5 an annotation sourcey 

6 a data packet stream generator in communication with said annotation 

7 source and said video encoder, ^id data packet stream generator producing encoded data 

8 packets; and / 

9 a multiplexe/ system in communication with said video encoder and said 

10 data packet stream generator, said multiplexer generating a digital broadcast signal 

1 1 comprising an augment/d transport stream from said transport stream and said encoded 

12 data packets, / 

13 wherein said/video encoder provides timing information to said data packet 

14 stream generator said data packet stream generator synchronizes aimotation data 

15 from said armotaftion source with a video signal from said video source in response to 

1 6 said timing infiormation. 

1 The system of claim 1 wherein said timing information comprises one of 

2 timestamp ikformation, timecode information, frame numbering information and global 

3 time of day. \ 

1 3. (The system of claim 1 wherein said aimotation data comprises mask data 

2 and at least one\of t^U^Jjiata and graphics data. 

1 4. Trie system of claim 3 wherein said mask data includes location 

2 information of anVobject in an annotated video frame. 
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1 5. \ The system of claim 4 wherein said location information includes a 

2 graphics location reference that represents a fixed relation to a set of pixels associated 

3 with said objeot. 



1 6. The system of claim 5 wherein said graphics location reference includes 

2 an upper left mc st pixel in said associated pixel set. 

1 7. The system of claim 5 wherein said graphics location reference includes a 

2 centroid pixel of said associated pixel set. 

1 8. The system of claim 3 wherein said mask data comprises location and 



2 shape informat 

1 9. 

2 graphical ovei 

1 10. 

2 outline of saic 

1 11. 

2 mathematical 



12. 



on of an object in a video fame to be annotated. 

The system of claim 8 wherein said shape information is represented by a 
ay of said object. 

The system of claim 8 wherein said shape information is represented by an 
object. 

The system of claim 8 wherein said shape information is represented by a 
epresentation of a set of pixels associated with said object. 

A hyperlinked broadcast and reception system comprising: 
video source; 

video cn/od^ in communication with said video source, said video 




4 encoder producing a tran: 



5 ah annotation source; 

6 a Uata packet stream generator in communication with said armotation 

7 source and said vi^co encoder, said data packet stream generator producing encoded data 

8 packets; 
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a naultiplexer system in communication with said video encoder and said 
data packet stream generator, said multiplexer generating a digital broadcast signal 
comprising an augmented transport stream from said transport stream and said encoded 
data packets; 

a broadcast channel in communication with said multiplexer system; 
a receiver in communication with said broadcast channel; and 
a displa)[ device in communication with said receiver, 
wherein said vie eo encoder provides timing information to said data packet 
stream generator and st id data packet stream generator synchronizes annotation data 
from said annotation sc urce with a video signal from said video source in response to 

1, and 

splay device displays said annotation data associated with said 



said timing informatioji, 
wherein said d 



video signal in response to a viewer request on a frame by frame basis. 

13. The system of claim 12 wherein said timing information comprises one of 
timestamp information, timecode information, frame numbering information and global 
time of day. 



1 14. The 

2 and at least one 



; ystem of claim 12, wherein said annotation data comprises mask data 
of textual data and graphics data. 



system of claim 14, wherein said mask data and said at least one of 
gra phics data are transmitted over separate streams in said broadcast 



1 15. The 

2 textual data and 

3 channel. 



1 16. The system of claim 14 wherein said mask data comprises location 

2 information of an object in an annotated video frame. 




1 17. The systW of claim 16 wherein said mask data further comprises shape 

2 information of an object m an annotated video frame. 
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The system of claim 12 wherein said timing information is employed to 



synchronize thevdisplay of annotation data from said annotation source with said video 
signal from said Video source. 



1 1 9. The\system of claim 1 8 wherein said timing information comprises one of 

2 timestamp information, timecode information, frame numbering information and global 

3 time of day. 



1 

2 
3 
4 
5 
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20. The sistem of claim 12 wherein said system transmits information related 



to said viewer reques 



1 21. The system 

2 channel is a store-anc 



to a remote location over a backchannel communications channel. 



of claim 20 wherein said backchannel communications 
forward channel. 



22. The system of claim 12, wherein said annotation data comprises 



information regarding 



goods and services for sale. 



1 23. The system of claim 12, wherein said annotation data comprises non- 

2 commercial informatic n. 



24. A hypeilinked reception system comprising: 

a receiver in communication with a broadcast chaimel; and 
a display device in communication with said receiver, 
wherein said receiver dqcodes a distal Broadcast signal to recover a video signal and 
annotation data; and I v^^xA. 

wherein, in response to a viewer request, said display device displays said 
annotation data associated wdth said video signal on a frame by frame basis. 



1 25. The system 6f claim 24 wherein timing information is employed to 

2 synchronize a display of saidVmotation data with said video signal. 
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1 25^\ The system of claim 25 wherein said timing inforaiation comprises one of 

2 timestamp infoi^ation, timecode information, frame numbering information and global 

3 time of day. 



1 27. The system of claim 25 wherein said receiver synchronizes said annotation 

2 data with said videfe signal in response to said timing information. 

1 28. The ^stem of claim 24 wherein said annotation data comprises a plurality 

2 of annotations having equal timing information, and said viewer request comprises an 

3 indication as to whicii armotation of said plurality of annotations is to be displayed. 

1 29. A hypminked reception system comprising: 

2 a receiver in communication with a broadcast channel; and 

3 a display device in communication with said receiver, 

4 wherein said display device displays annotation data associated with a video 

5 signal, in response to a viewer request, on a frame by frame basis, said annotation data 

6 being associated with said video signal in response to timing information. 

1 30. The sysmm of claim 29 wherein said timing information comprises one of 

2 timestamp information,|timecode information, frame numbering information and global 

3 time of day. 
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31, A methodlof generating a hyperlinked video signal, comprising: 
providing a source video; 

encoding said source vid€6 with a video encoder to produce a transport 
stream and timing information; [ / 

providing a source of annotation data; 

conamvmicating said transport stream and timing information from said 
video encoder and said annotation data from said source of annotation data to a data 
packet stream generator, said cjata packet stream generator synchronizing said annotation 
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9 data witnkvideo signal from said video source in response to said timing information 

10 and producing encoded data packets. 

1 32. The method of claim 31 wherein said timing information comprises one of 

2 timestamp infornration, timecode information, frame numbering information and global 

3 time of day. \ 

1 33. The method of claim 3 1 , wherein said annotation data comprises 

2 information regardimg goods and services for sale. 

1 34. The method of claim 3 1 , wherein said annotation data comprises non- 

2 commercial informakion. 

1 35. The method of claim 3 1 wherein said annotation data comprises mask data 

2 and at least one of textual data and graphics data. 

1 36. The method of claim 35 wherein said mask data includes location 

2 information of an object in an armotated video frame. 

1 37. The method of claim 36 wherein said location information includes a 

2 graphics location reference that represents a fixed relation to a set of pixels associated 

3 with said object. 

1 38. The method of clainr3^7^hot;ein,said graphics location reference includes 

2 an upper left most pixel in said associated pixel set. 

1 39. The method of claim 38 wherein said graphics location reference includes 

2 a centroid pixel of said associated pixel set. 

1 40. The method of claim 35 wherein said mask data comprises location and 

2 shape information of aoypbject in an annotated video frame. 
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41. X The method of claim 40 wherein said shape information is represented by 
a graphical overlay of said object. 



42. TheVnethod of claim 40 wherein said shape information is represented by 
an outline of said object. 



43. The mkhod of claim 40 wherein said shape information is represented by 
a mathematical repres(;ntation of a set of pixels associated with said object. 

44. The method of claim 3 1 , further comprising: 
communicating! said transport stream and said encoded data packets to a 

multiplexer system, said multiplexer system generating a hyperlinked digital broadcast 
signal comprising an Augmented transport stream from said transport stream and said 
encoded data packets] 



45. The niethod of claim 44 wherein said annotation data comprises mask data 
and at least one of textual data and graphics data and wherein said mask data and said at 
least one of textual c ata and graphics data represent separate streams contained in said 
hyperlinked digital t roadcast signal. 



rpethod of claim 44, further comprising: 
said hyperlinted digital broadcast signal. 




46. The 
broadcasting 



47. A mq'thod of v}^\\^<fg^|!iiyperlinked video signal, comprising: 
receiving a hjyperlinked video signal comprising an augmented transport stream; 
demultiplexi: ig said augmented transport stream to recover a transport stream and 

encoded data packets; 
displaying sa d transport stream framewise as a video on a display; 
decoding said data packets to recover annotation data and timing information; 
synchronizin^said annotation data with said video using said timing information; 
and 
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9 in response to a viewer request, displaying said annotation data on said display on 

10 a frame by frameNpasis. 



1 48. The niethod of claim 47 wherein said timing information comprises one of 

2 timestamp informatior^, timecode information, frame numbering information and global 

3 time of day. 
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49. The 
transmitting 
backchannel 



metHod of claim 47, further comprising 

infojrmation related to said viewer request to a remote location over a 
communicitions channel. 



50. The met! od of claim 47, further comprising: 

in response to a viewer prompt, accepting from a viewer information regarding a 
commercial transaction, and completing said transaction. 

5 1 . The metnod of claiii^Sp^Vj^ the information regarding a commercial 
transaction accepted from a viewer comprises at least one of a viewer's identifier, a 
viewer's address, an identifier of a viewer's financial account, a viewer's password, a 
viewer's personal identification number, a quantity, a model, a size, a color, a descriptor 
of a good or service to be vended, and a price. 
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